Add PyPI download tracking support - #2
Open
SkalskiP wants to merge 553 commits into
Open
Conversation
- Add startrack/pypi.py module for fetching daily downloads from pypistats.org - Add startrack/discover.py CLI tool to help discover PyPI packages from GitHub orgs - Track downloads via INPUT_PYPI_PACKAGES env var (explicit package list) - Output PyPI stats to data/pypi_data.csv Bug fixes and improvements: - Fix Path.exists() incorrect static method call in app.py - Fix crash when INPUT_ORGANIZATIONS env var is not set - Add error handling for GitHub API failures - Add rate limit handling for GitHub API requests - Check pyproject.toml, setup.py, and setup.cfg for package discovery Other changes: - Rename data.csv to github_data.csv for clarity - Update GitHub Action to support pypi_packages input - Add tomli dependency for TOML parsing
- Detect and wait on 403 rate limit responses before retrying - Handle exceptions from concurrent futures gracefully - Log clear ERROR/WARNING messages for failed requests - Limit concurrent workers to 5 to reduce rate limit pressure - Prevent duplicate date rows by replacing existing entries - Add per_page=100 to reduce total API calls
SkalskiP
force-pushed
the
feature/add-pypi-download-tracking
branch
from
February 21, 2026 22:12
745318d to
d5d54e6
Compare
Add PyPI download tracking support
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
INPUT_PYPI_PACKAGESenv var to specify packages to trackpython -m startrack.discover) to help users find packages from GitHub orgsdata.csvtogithub_data.csvfor consistency withpypi_data.csv